CentOS 6
Sponsored Link

OpenStack Icehouse : Use Virtual Storage(GlusterFS)
2014/06/26
 
It's possible to use the Virtual Storage provided by Cinder if an Instance needs more disks.
Configure Virtual storage with GlusterFS backend on here. 
                                      +------------------+           +------------------+
                             10.0.0.35| [ Storage Node ] |  10.0.0.61|                  |
+------------------+            +-----+   Cinder-Volume  |     +-----+   GlusterFS #1   |
| [ Control Node ] |            | eth0|                  |     | eth0|                  |
|     Keystone     |10.0.0.30   |     +------------------+     |     +------------------+
|      Glance      |------------+------------------------------+
|     Nova API     |eth0        |     +------------------+     |     +------------------+
|    Cinder API    |            | eth0| [ Compute Node ] |     | eth0|                  |
+------------------+            +-----+   Nova Compute   |     +-----+   GlusterFS #2   |
                             10.0.0.51|                  |  10.0.0.62|                  |
                                      +------------------+           +------------------+
[1]
GlusterFS server is required to be running on your LAN. This example uses a replication volume "vol_replica" provided by "gfs01" and "gfs02".
[2] Configure Storage Node.
# install from EPEL

[root@storage ~]#
yum --enablerepo=epel -y install glusterfs glusterfs-fuse
[root@storage ~]#
vi /etc/cinder/cinder.conf
# add follows in the [DEFAULT] section

volume_driver=cinder.volume.drivers.glusterfs.GlusterfsDriver
glusterfs_shares_config=/etc/cinder/glusterfs_shares
glusterfs_mount_point_base=/var/lib/cinder/mnt
[root@storage ~]#
vi /etc/cinder/glusterfs_shares
# create new : specify GlusterFS volumes

gfs01.srv.world:/vol_replica
[root@storage ~]#
chmod 640 /etc/cinder/glusterfs_shares

[root@storage ~]#
chgrp cinder /etc/cinder/glusterfs_shares

[root@storage ~]#
mkdir /var/lib/cinder/mnt

[root@storage ~]#
chown cinder. /var/lib/cinder/mnt

[root@storage ~]#
/etc/rc.d/init.d/openstack-cinder-volume restart

Stopping openstack-cinder-volume: [ OK ]
Starting openstack-cinder-volume: [ OK ]
[3] Configure Compute Node to mount GlusterFS volume.
# install from EPEL

[root@node01 ~]#
yum --enablerepo=epel -y install glusterfs glusterfs-fuse
[root@node01 ~]#
vi /etc/nova/nova.conf
# add follows in the [DEFAULT] section

volume_drivers="glusterfs=nova.virt.libvirt.volume.LibvirtGlusterfsVolumeDriver"
[root@node01 ~]#
/etc/rc.d/init.d/openstack-nova-compute restart

Stopping openstack-nova-compute: [ OK ]
Starting openstack-nova-compute: [ OK ]
[4] For example, create a virtual disk "disk01" with 10GB. It's OK to work on any node. (This example is on Control Node)
[root@dlp ~(keystone)]#
cinder create --display_name disk01 10 

+---------------------+--------------------------------------+
|       Property      |                Value                 |
+---------------------+--------------------------------------+
|     attachments     |                  []                  |
|  availability_zone  |                 nova                 |
|       bootable      |                false                 |
|      created_at     |      2014-06-27T04:24:35.641047      |
| display_description |                 None                 |
|     display_name    |                disk01                |
|      encrypted      |                False                 |
|          id         | f8e4e24e-4736-454c-87db-cd028540b134 |
|       metadata      |                  {}                  |
|         size        |                  10                  |
|     snapshot_id     |                 None                 |
|     source_volid    |                 None                 |
|        status       |               creating               |
|     volume_type     |                 None                 |
+---------------------+--------------------------------------+
[root@dlp ~(keystone)]#
cinder list 

+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
|                  ID                  |   Status  | Display Name | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
| f8e4e24e-4736-454c-87db-cd028540b134 | available |    disk01    |  10  |     None    |  false   |             |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
[5] Attach the virtual disk to an Instance.
For the exmaple below, the disk is connected as "/dev/vdb". It's possible to use it as a storage to create a file system on it.
[root@dlp ~(keystone)]#
nova list 

+-----------+-----------+---------+------------+-------------+--------------------------+
| ID        | Name      | Status  | Task State | Power State | Networks                 |
+-----------+-----------+---------+------------+-------------+--------------------------+
| 90304be0- | CentOS_65 | SHUTOFF | -          | Shutdown    | sharednet1=192.168.100.2 |
+-----------+-----------+---------+------------+-------------+--------------------------+
[root@dlp ~(keystone)]#
nova volume-attach CentOS_65 f8e4e24e-4736-454c-87db-cd028540b134 auto 

+----------+--------------------------------------+
| Property | Value                                |
+----------+--------------------------------------+
| device   | /dev/vdb                             |
| id       | f8e4e24e-4736-454c-87db-cd028540b134 |
| serverId | 90304be0-c9e7-4632-b39f-ac734a8bfb1e |
| volumeId | f8e4e24e-4736-454c-87db-cd028540b134 |
+----------+--------------------------------------+
 
Tweet